Security Vulnerability in Face Mask Monitoring System

The COVID-19 pandemic has increased demand for face mask detection systems that utilize deep learning and machine learning algorithms. However, these systems are susceptible to adversarial attacks, where an attacker can manipulate the system to make incorrect predictions. This study aimed to test the vulnerability of a deep learning-based face mask detection model to a specific type of attack called a black box adversarial attack in which the attacker possesses only partial information about the target model. The study's findings showed that the attack successfully reduced the model's accuracy from 96.48% to 49.25%. This emphasizes the need for more robust defense mechanisms in face mask detection systems to ensure their reliability. © 2023 Bharati Vidyapeeth, New Delhi.

Performance of COVID Face Mask Detection Based on SVM Algorithm Using OpenCV DNN as Preprocessing Model

As COVID-19 became a pandemic in the world, wearing a mask has become one of the best measures to prevent the spread of the epidemic, so face mask recognition in public places has become a very important part of controlling the epidemic. This paper mainly tests the performance of the OpenCV DNN preprocessing model (OpenCV DNN + SVM) based on the SVM algorithm model in the face mask recognition dataset. The dataset I use is from Kaggle called COVID Face Mask Detection Dataset. This dataset contains 503 face images with masks and 503 face images without masks. I test the performance of using OpenCV DNN + SVM and using only the SVM algorithm to evaluate this study by setting a control experimental group. In this study, it was found that using OpenCV DNN + SVM, the accuracy of ROI parameters and SVM parameters can reach 93.06% and F1score can also reach 93.06% without a lot of adjustment. The accuracy rate can only reach 68.31%, and the F1score reaches 68.31%. Findings suggest that the method using OpenCV DNN + SVM can achieve slightly better results in the COVID Face Mask Detection Dataset, and can perform better than only using the SVM algorithm. In addition, using OpenCV DNN preprocessing model based on the SVM algorithm plays an important role in feature extraction in face mask recognition. If the developer does enough parameters tuning, the accuracy will also increase. © 2022 SPIE.

Untargeted white-box adversarial attack to break into deep leaning based COVID-19 monitoring face mask detection system.

The face mask detection system has been a valuable tool to combat COVID-19 by preventing its rapid transmission. This article demonstrated that the present deep learning-based face mask detection systems are vulnerable to adversarial attacks. We proposed a framework for a robust face mask detection system that is resistant to adversarial attacks. We first developed a face mask detection system by fine-tuning the MobileNetv2 model and training it on the custom-built dataset. The model performed exceptionally well, achieving 95.83% of accuracy on test data. Then, the model's performance is assessed using adversarial images calculated by the fast gradient sign method (FGSM). The FGSM attack reduced the model's classification accuracy from 95.83% to 14.53%, indicating that the adversarial attack on the proposed model severely damaged its performance. Finally, we illustrated that the proposed robust framework enhanced the model's resistance to adversarial attacks. Although there was a notable drop in the accuracy of the robust model on unseen clean data from 95.83% to 92.79%, the model performed exceptionally well, improving the accuracy from 14.53% to 92% on adversarial data. We expect our research to heighten awareness of adversarial attacks on COVID-19 monitoring systems and inspire others to protect healthcare systems from similar attacks.

FACE MASK RECOGNITION SYSTEM ON RESTAURANT WITH SELF-PAYMENT SYSTEM USING CONVOLUTIONAL NEURAL NETWORK (CNN)

COVID-19 is a disease that affects many aspects of life transmitted by verbal interaction. Nowadays the rapid growth of COVID-19 has become an international issue due to violation of the face mask rules. This research will provide a comparison of the deep learning class, Convolutional Neural Network (CNN) which is used as the basis of the face mask recognition system and to adapt it into a payment verification system. This research will use MobileNetv2 and YOLO-v4 with its pretrained model using group of images composed of person using face mask and person not using face mask. Each model successfully performs the detection task. The result shows that MobileNetv2 has achieved a better overall percentage compared to the YOLO-v4 algorithm. Hence, MobileNetv2 has been chosen as the algorithm used for the payment verification system. © ICIC International.

Comparative analysis of different scene for face mask detection based on YOLOv4

The 2019-nCoV can be transmitted through respiratory droplets and other methods, which greatly endangers public health security. Wearing masks correctly has been proven to be one of the effective means to prevent virus infection, but limited by the complexity of practical application scenarios, the wearing of masks still relies heavily on manual supervision. Therefore, a fast and accurate face mask wearing detection method is urgently needed. In this paper, a mask detection algorithm based on improved YOLO-v4 is proposed as a solution to the problems of low accuracy, poor real-time performance, and poor robustness caused by complicated environments. In addition, a number of different training approaches, such as mosaic data augment, CIOU, label smoothing, cosine annealing, etc., are introduced. These techniques help to increase the training speed of the model as well as the accuracy of its detection. With a fast-training model, the model will be able to detect and compare the results of samples from different scenarios. The experiment will compare front and side faces, different colored masks, scenes of varying complexity and other perspectives in a systematic way. The experiment's result was able to reach 99.38 % accuracy after the model was trained using data from a variety of face masks being worn. Experiment results, both quantitative and qualitative, indicate that the method can be adapted to most scenarios and offers effective ideas for improvement. © 2023 SPIE.

TFM a Dataset for Detection and Recognition of Masked Faces in the Wild

Droplet transmission is one of the leading causes of the spread of respiratory infections, such as coronavirus disease (COVID-19). The proper use of face masks is an effective way to prevent the transmission of such diseases. Nonetheless, different types of masks provide various degrees of protection. Hence, automatic recognition of face mask types may benefit the control access to facilities where a specific protection degree is required. In the last two years, several deep learning models have been proposed for face mask detection and properly wearing mask recognition. However, the current publicly available datasets do not consider the different mask types and occasionally lack real-world elements needed to train robust models. In this paper, we introduce a new dataset named TFM with sufficient size and variety to train and evaluate deep learning models for face mask detection and recognition. This dataset contains more than 135,000 annotated faces from about 100,000 photographs taken in the wild. We consider four mask types (cloth, respirators, surgical and valved) as well as unmasked faces, of which up to six can appear in a single image. The photographs were mined from Twitter within two years since the beginning of the COVID-19 pandemic. Thus, they include diverse scenes with real-world variations in background and illumination. With our dataset, the performance of four state-of-the-art object detection models is evaluated. The experimental results show that YOLOv5 can achieve about 90% of mAP@0.5, demonstrating that the TFM dataset can be used to train robust models and may help the community step forward in detecting and recognizing masked faces in the wild. Our dataset and pre-trained models used in the evaluation will be available upon the publication of this paper. © 2022 ACM.

An Effective and Efficient Face Mask Recognition System for Edge Devices

Wearing face masks is a simple but effective measure to mitigate the spread of COVID-19. Instead of manually searching persons without a face mask, designing an intelligent system to automatically detect and recognize them is necessary. The system is usually deployed on portable edge devices in order to be used in complex environments. As these devices have limited memory and computing power, popular large models are not suitable. In this paper, we propose a novel face mask recognition system, which consists of four modules: face detection, mask recognition, liveness detection, and face recognition. Experimental results verify that the proposed system has low latency, low memory burden, and satisfactory performance. © 2022 IEEE.

An Improved Face Mask-aware Recognition System Based on Deep Learning

Face mask detection and recognition have been incorporated into many applications in daily life, especially during the current COVID-19 pandemic. To mitigate the spread of coronavirus, wearing face masks has become commonplace. However, traditional face detection and recognition systems utilize main facial features such as the mouth, nose, and eyes to determine a person’s identity. Masks make facial detection and recognition tasks more challenging since certain parts of the face are concealed. Yet, how to improve the performance of existing systems with a face mask overlaid on the original face input images remains an open area of inquiry. In this study, we propose an improved face mask-aware recognition system named ‘MAR’ based on deep learning, which can tackle challenges in face mask detection and recognition. MAR consists of five main modules to handle various kinds of input images. We re-train the CenterNet model with our augmented face mask inputs to perform face mask detection and propose four variations on face mask recognition models based on the pre-trained ArcFace to handle facial recognition. Finally, we demonstrate the effectiveness of our proposed models on the VGGFACE2 dataset and achieve a high accuracy score on both detection and recognition tasks. © 2022, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

COVID-19 Face Mask Recognition with Advanced Face Cut Algorithm for Human Safety Measures

In the last year, the outbreak of COVID-19 has deployed computer vision and machine learning algorithms in various fields to enhance human life interactions. COVID-19 is a highly contaminated disease that affects mainly the respiratory organs of the human body. We must wear a mask in this situation as the virus can be contaminated through the air and a non-masked person can be affected. Our proposal deploys a computer vision and deep learning framework to recognize face masks from images or videos. We have implemented a Boundary dependent face cut recognition algorithm that can cut the face from the image using 27 landmarks and then the preprocessed image can further be sent to the deep learning ResNet50 model. The experimental result shows a significant advancement of 3.4 percent compared to the YOLOV3 mask recognition architecture in just 10 epochs. © 2021 IEEE.

Face Mask Wearing Detection Algorithm Based on Improved YOLO-v4.

To solve the problems of low accuracy, low real-time performance, poor robustness and others caused by the complex environment, this paper proposes a face mask recognition and standard wear detection algorithm based on the improved YOLO-v4. Firstly, an improved CSPDarkNet53 is introduced into the trunk feature extraction network, which reduces the computing cost of the network and improves the learning ability of the model. Secondly, the adaptive image scaling algorithm can reduce computation and redundancy effectively. Thirdly, the improved PANet structure is introduced so that the network has more semantic information in the feature layer. At last, a face mask detection data set is made according to the standard wearing of masks. Based on the object detection algorithm of deep learning, a variety of evaluation indexes are compared to evaluate the effectiveness of the model. The results of the comparations show that the mAP of face mask recognition can reach 98.3% and the frame rate is high at 54.57 FPS, which are more accurate compared with the exiting algorithm.